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DETAILED ACTION 
Drawings 

1 . The drawings are objected to as failing to comply with 37 CFR 1 .84(p)(5) because they 
include the following reference character(s) not mentioned in the description: 734-1, 734-2, and 
734-3 in FIG. 14. Corrected drawing sheets in compliance with 37 CFR 1.121(d), or amendment 
to the specification to add the reference character(s) in the description in compliance with 37 
CFR 1.121(b) are required in reply to the Office action to avoid abandonment of the application. 
Any amended replacement drawing sheet should include all of the figures appearing on the 
immediate prior version of the sheet, even if only one figure is being amended. Each drawing 
sheet submitted after the filing date of an application must be labeled in the top margin as either 
"Replacement Sheet" or "New Sheet" pursuant to 37 CFR 1.121(d). If the changes are not 
accepted by the examiner, the applicant will be notified and informed of any required corrective 
action in the next Office action. The objection to the drawings will not be held in abeyance. 

Specification 

2. The title of the invention is not descriptive. A new title is required that is clearly 
indicative of the invention to which the claims are directed. 

The following title is suggested: A method and apparatus for rendering a three- 
dimensional object using brush images. 

3. The lengthy specification has not been checked to the extent necessary to determine the 
presence of all possible minor errors. Applicant's cooperation is requested in correcting any 
errors of which applicant may become aware in the specification. 
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Claim Rejections - 35 USC §101 

4. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or 
any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

5. Claims 20, 22 and 23 rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. 

6. Claims 20 and 22 are directed to a "data signal," which is nothing but the physical 
characteristics of a form of energy, and as such is nonstatutory natural phenomena. 

7. Claim 23 recites a computer program not technologically embodied to enable the 
functionality to be realized. Computer programs, per se, are not in one of the statutory categories 
of invention. Functional descriptive material claimed in combination with an appropriate 
computer readable medium to enable the functionality to be realized is patent eligible subject 
matter if it is capable of producing a useful, concrete and tangible result when used in the 
computer system. See MPEP § 2106 with regard to computer programs. 

8. To expedite a complete examination of the instant application, the claims rejected under 
35 U.S.C. 101 as non-statutory subject matter are further rejected as set forth below in 
anticipation of applicant amending the claims to place them within the four categories of 
invention. 

Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
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having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

10. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1, 148 USPQ 459 
(1966), that are applied for establishing a background for determining obviousness under 35 
U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating obviousness 
or nonobviousness. 

1 1 . This application currently names joint inventors. In considering patentability of the 
claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various 
claims was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1 .56 to point out 
the inventor and invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the applicability of 35 U.S.C. 103(c) 
and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 

12. Claims 1-4 and 7-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
U.S. Patent No. 5,966,134 to Arias in view of Barbra J. Meier, "Painterly Rendering for 
Animation," Aug. 4, 1996, SIGGRAPH '96 Conference Proceedings, p. 477-484 (herein 
referred to as "Meier"). 

13. With regard to claim 1, Arias discloses "an image generating method for rendering a 
three-dimensional object viewed from a predetermined viewpoint by generating an image of the 
three-dimensional object and writing color information on the image generated in a rendering 
buffer, the method comprising: 
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a. generating at least one of retouched image of the three-dimensional image by 
arranging colored lines and soft edged black lines within a rendering region for the three- 
dimensional object, the rendering region on which the three-dimensional object is 
projected on the basis of the predetermined viewpoint (lines 5-8 of column 13: "...the 
data in FBI are composited by combining the data with the composited data stored in the 
RGBA frame buffer, which were defined by the last step in column 142. "; lines 37-39 of 
column 2: "The colored image, color lines, and contour lines are composited to produce 
the eel image. "; lines 33-35 of column 12: "The surface-normal vector frame buffer 
therefore is a record of the shapes of the objects seen by an imaginary camera viewing 
the scene. "); 

b. generating a projection image by projecting the three-dimensional object on the 
basis of the predetermined viewpoint (Figure 3; lines 7-10 of column 8: "The Toon_Paint 
shader is called for each intersection of a primary ray with the surface to determine the 
color (RGB components and alpha value) associated with the pixel for storage in the 
frame buffer. "); and 

c. rendering the image of the three-dimensional object so as to reflect color 
information of the projection image at a part at which the retouched image is transparent 
(lines 13-16 of column 12: <( The resulting image typically includes soft-edged black lines 
disposed between the differently colored regions determined previously using the 
ToonJPaint material shader. ") by synthesizing the retouched image with the projection 
image" (lines 8-13 of column 12: "Finally, the color lines that have been smoothed by the 
previous step and stored as data in FBI are composited with the colored image defined 
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by the RGB A values. As indicated in column 142, for each pixel at location x,y, a new 
RGBA value is determined that is equal to the product of the RGBA value and the value 
stored in FBI for the pixel at location x,y. "). 

14. Arias discloses rendering in the style of eel animation, and consequently, Arias does not 
disclose arranging "brush images." Meier discloses "generating at least one of retouched image 
(Figure 3 shows an output image) of the three-dimensional image by arranging a plurality of 
brush images (Figures 3 and 4 show brush images; 3rd paragraph of section 3.3: (l For example, 
we may specify that brush rotations be determined by an orientation reference picture... 8th 
paragraph of section 3.2: 'To apply the attributes, the brush image is either used directly or cut 
from a sheet of texture. ..rotated to the orientation... ") so as to superpose a part of the plurality 
of brush images on one another part of the plurality of brush images within a rendering region 
for the three-dimensional object, the rendering region on which the three-dimensional object is 
projected on the basis of the predetermined viewpoint (2 nd paragraph of section 3: 'We begin by 
creating a particle set that represents geometry such as a surface... We use a painter 's algorithm 
to render particles as 2d brush strokes starting with the particles furthest from the viewpoint, 
and continuing until all particles are exhausted. Each brush stroke renders one particle. "). 

15. Arias and Meier are analogous art because they are from the same field of endeavor: non- 
photorealistic rendering. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to generate a retouched image by employing the rendering algorithm 
disclosed by Meier and use this retouched image in the system disclosed by Arias. The 
motivation for doing so would have been to simulate brush strokes as suggested by Meier, in the 
section paragraph of section 1, "brush strokes of a painting contribute to the abstraction of its 



Application/Control Number: 10/661,645 Page 7 

Art Unit: 2628 

subject and add another dimension to which a viewer can respond." Therefore, it would have 
been obvious to combine Arias with Meier to obtain the invention specified in claim 1 . 

16. Claim 21 recites limitations similar in scope to those of claim 1. The limitations of claim 
1 were shown to be met by the combination of Arias and Meier. Furthermore, Arias discloses an 
image generating apparatus (Figure 7). 

17. With respect to claims 20, 22 and 23, the storage medium, data signal, and program 
recited in claims 20, 22 and 23, respectively, are comprised by the apparatus shown by Arias in 
Figure 1 and in lines 5-20 of column 5. As previously shown, the combination of Arias and 
Meier shows the method recited in claim 1 . 

1 8. With regard to claim 2, Arias further discloses "generating an edge image of the three- 
dimensional object on the basis of the predetermined viewpoint (lines 1 7-22 of column 12: 
"Columns 144 and 146 in FIG. 8 respectively define the general steps and related details for 
determining the lines that define surface contours for the toon look image that is being produced. 
As noted above, contour lines follow the outlines of an object as well as defining curves on its 
interior surfaces. "; lines 33-35 of column 12: 'The surface-normal vector frame buffer therefore 
is a record of the shapes of the objects seen by an imaginary camera viewing the scene. "), 
wherein the rendering the image of the three-dimensional object includes rendering the image of 
the three-dimensional object by synthesizing the retouched image, the projection image and the 
edge image" (lines 37-39 of column 2: " The colored image, color lines, and contour lines are 
composited to produce the eel image. "). 

19. At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to further modify the combination of Arias and Meier to incorporate an edge image, as further 
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taught by Arias. The motivation for doing so would have been to clearly define the edges of 
objects in the scene to distinguish it from its surroundings, as well as give the image a "toon 
look" quality. Therefore, it would have been obvious to further modify the combination of Arias 
and Meier to obtain the invention specified in claim 2. 

20. Claim 3 is met by the combination of Arias and Meier, wherein Meier discloses "setting a 
light source in an object space in which the three-dimensional object is provided; and calculating 
shadow information of the three-dimensional object by performing predetermined rendering 
processing on the basis of the predetermined viewpoint and the light source set (3 rd paragraph of 
section 3.2: "The reference picture used for color information is typically a smooth-shaded 
rendered image of the surface with appropriate color attributes and lighting. "; Figure 2 shows 

if create reference pictures using geometry, surface attributes, and lighting; Figure 3 shows 
shading the geometry to create a color reference image; Figure 8 shows shadow information), 
wherein the arranging a plurality of brush images so as to superpose a part of the plurality of 
brush images on one another part of the plurality of brush images includes determining 
arrangement positions at which the plurality of brush images are arranged on the basis of the 
shadow information calculated {Figure 8 shows brush images arranged according to shadow 
information; 3 paragraph of section 5.1: "...shadows may be painted as a separate layer and 
composited... "). 

21 . Claim 4 is met by the combination of Arias and Meier, wherein Meier discloses "the 
arranging a plurality of brush images so as to superpose a part of the plurality of brush images on 
one another part of the plurality of brush images includes determining the arrangement positions 
for the plurality of brush images so that density of the plurality of brush images in a low 
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brightness part is higher than density of the plurality of brush images in a high brightness part on 
the basis of the shadow information calculated" (6 th paragraph of section 3.2 (emphasis added): 
"We linearly map the range of values in the image to the range of user-specified sizes so that the 
areas with small values are painted with the smallest brushes and the areas with high values are 
painted with the largest brushes. Again, we can use lizhtinz, texture maps, or specialized 
shaders to achieve the desired look "). One of ordinary skill in the art would recognize the 
"lighting, texture maps, or specialized shaders" are analogous to shadow information as broadly 
recited in claim 4. 

22. Claim 7 is met by the combination of Arias and Meier, wherein Meier discloses "the 
generating at least one of retouched image of the three-dimensional image includes generating at 
least one of retouched image by changing brightness information of the plurality of brush images 
on the basis of shadow information at positions at which the plurality of brush images are 
arranged" (8 th paragraph of section 3.2 (emphasis added): "To apply the attributes, the brush 
image is either used directly or cut from a sheet of texture, multiplied by the 

colo r . , . corresponding reference picture or by data stored with the particle. "; Figure 8 shows 
brightness of a brush image corresponding to the shadow information). One of ordinary skill in 
the art would recognize from Figure 3 and Figure 8, color attributes from the rendered reference 
picture correspond to the brightness of the brush image. 

23. Claim 8 is met by the combination of Arias and Meier, wherein Meier discloses "the 
generating at least one of retouched image of the three-dimensional image includes: 

d. operating a normal line to a surface of the three-dimensional object (5 th 
paragraph of section 3.2: "The reference picture that encodes orientation information is 
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an image made with a specialized shader that encodes surface normals in the resulting 
image. This surface normal shader projects the 3d surface normals into two dimensions 
along the view vector or another specified vector. "); and 

e. performing processing for determining an arrangement angle of each of the 
plurality of brush images on the basis of the normal line operated for a position on the 
surface of the three-dimensional object {3rd paragraph of section 3.3: "For example, we 
may specify that brush rotations be determined by an orientation reference picture... "; 
8th paragraph of section 3.2: "To apply the attributes, the brush image is either used 
directly or cut from a sheet of texture... rotated to the orientation... 

f. the position corresponding to an arrangement position at which each of the 
plurality of brush images is arranged, and arranging each of the plurality of brush images 
at the arrangement angle determined {Figure 3 caption: "The renderer looks up brush 
stroke attributes in the reference pictures at the screen space location given by each 
particle 's position and renders brush strokes that are composited into the final rendered 
image. "). 

24. With regard to claim 9, Meier further teaches "executing predetermined rendering 
processing on the basis of the predetermined viewpoint {Figure 3 caption: "The surface 
geometry is rendered using various shaders to create brush stroke attribute reference pictures. "; 
5 paragraph of section 3.2: "The reference picture that encodes orientation information is an 
image made with a specialized shader that encodes surface normals in the resulting image. This 
surface normal shader projects the 3d surface normals into two dimensions along the view 
vector or another specified vector. "), and generating a normal image expressing the normal line 
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to the surface of the three-dimensional object in color information (Figure 3 caption: "Note that 
the arrows in the orientation image are representational in this diagram; the orientations are 
actually encoded in the color channels of the image. "), and arranging each of the plurality of 
brush images includes performing processing for determining the arrangement angle of each of 
the plurality of brush images (3rd paragraph of section 3.3: "For example, we may specify that 
brush rotations be determined by an orientation reference picture... "; 8th paragraph of section 
3.2: "To apply the attributes, the brush image is either used directly or cut from a sheet of 
texture... rotated to the orientation... "), on the basis of color information at a position of the 
normal image, the position corresponding to the arrangement position at which each of the 
plurality of brush images is arranged, and arranging each of the plurality of brush images at the 
arrangement angle determined (Figure 3 caption: "The renderer looks up brush stroke attributes 
in the reference pictures at the screen space location given by each particle 's position and 
renders brush strokes that are composited into the final rendered image. "). 
25. Although Meier discloses a shader, Meier does not expressly disclose emitting light rays 
from multiple light sources. Arias discloses "providing a first light source for emitting light rays 
in a first direction crossing at a right angle with an eyes line direction of the predetermined 
viewpoint and a second light source for emitting light rays in a second direction crossing at a 
right angle with the eyes line direction of the predetermined viewpoint, irradiating the light rays 
emitted from the first light source and the light rays emitted from the second light source to the 
three-dimensional object" (lines 59-66 of column 6: "As shown in this simplified illustration, a 
primary light ray 76 is cast toward an object 72 for one pixel of a frame 70. In the rendering 
process, rays are cast from each pixel toward the object, but only one is shown in this simplified 
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view. The primary rays are cast into the scene in a direction determined by the ray tracing 
program or by a "lens shader n interposed between the light source and the object being 
rendered. "; lines 8-11 of column 7: 'Thus, if additional light sources illuminate the object, 
additional rays are cast to the ray/surface intersection point from the light sources so that the 
material color is determined by summing the contribution of each light source. "). 

26. At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to use the shader operations as disclosed by Arias in Meier's shader {Figure 3). The motivation 
for doing so would have been create realistic reference images by simulating the physical 
transport of light, as suggested by Meier in Figure 2 and Figure 3. Therefore, it would have been 
obvious to further modify the combination of Arias and Meier to obtain the invention specified 
in claim 9. 

27. With regard to claim 10, Meier further discloses "the image generating method as 
claimed in claim 9, wherein 

g. the operating the normal line to the surface of the three-dimensional object 
includes generating the normal image, executing the predetermined rendering processing 
(5 th paragraph of section 3.2: "This surface normal shader projects the 3d surface 
normals into two dimensions along the view vector or another specified vector. "), and 

h. operating values of each of pixels of the surface of the three-dimensional object, 
and the arranging each of the plurality of brush images includes determining the 
arrangement angle of each of the plurality of brush images at the arrangement position at 
which each of the plurality of brush images are arranged by operating a direction 
corresponding to the normal line at the arrangement position {Figure 3 caption: "The 
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Tenderer looks up brush stroke attributes in the reference pictures at the screen space 
location given by each particle r s position and renders brush strokes that are composited 
into the final rendered image. "; 3rd paragraph of section 3.3: "For example, we may 
specify that brush rotations be determined by an orientation reference picture... "; 8th 
paragraph of section 3.2: "To apply the attributes, the brush image is either used directly 
or cut from a sheet of texture... rotated to the orientation... ") 

i. at which each of the plurality of brush images is arranged on the basis of a value 
of the light ray color of the first light source and a value of the light ray color of the 
second light source of values of the normal image {Figure 3 caption: "...the orientations 
are actually encoded in the color channels of the image. "). 

28. Meier does not expressly disclose "the rendering buffer is formed so as to store RGB 
values for every pixel," and "generating the normal image, by setting a light ray color of the first 
light source to be a first color of RGB and a light ray color of the second light source to be a 
second color of the RGB other than the first color." 

29. At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to incorporate the features of "the rendering buffer is formed so as to store RGB values 
for every pixel," and "generating the normal image, by setting a light ray color of the first light 
source to be a first color of RGB and a light ray color of the second light source to be a second 
color of the RGB other than the first color" in the system disclosed by the combination of Arias 
and Meier. As shown, Meier discloses the normals are two dimensional (5th paragraph of 
section 3.2 (emphasis added): "This surface normal shader projects the 3d surface normals into 
two dimensions along the view vector or another specified vector. ") and stored in the color 
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channels of the image (Figure 3 caption: "...the orientations are actually encoded in the color 
channels of the image. "); therefore, the motivation for doing so would have been to simplify 
implementation of the system by conveniently storing the components within the existing 
framework (images comprising pixels with RGB channels), and by ensuring a one-to-one 
correspondence between orientation attributes and brush image locations by providing a value at 
each location in the rendering buffer. Therefore, it would have been obvious to combine Arias 
with Meier to obtain the invention specified in claim 10. 

30. Claim 1 1 is met by the combination of Arias and Meier, wherein Meier discloses "further 
comprising operating a direction from a predetermined position of the normal image generated to 
the arrangement position at which each of the plurality of brush images is arranged, wherein the 
determining the arrangement angle of each of the plurality of brush images includes determining 
the arrangement angle of each of the plurality of brush images (3 rd paragraph of section 3.3: 
"For example, we may specify that brush rotations be determined by an orientation reference 
picture... "; 8 th paragraph of section 3.2: "To apply the attributes, the brush image is either used 
directly or cut from a sheet of texture... rotated to the orientation... ") by synthesizing the 
direction operated with a direction obtained on the basis of the color information of the normal 
image" (5 th paragraph of section 3.2: 'The reference picture that encodes orientation 
information is an image made with a specialized shader that encodes surface normals in the 
resulting image. This surface normal shader projects the 3d surface normals into two dimensions 
along the view vector or another specified vector. "; Figure 3 caption: "Note that the arrows in 
the orientation image are representational in this diagram; the orientations are actually encoded 
in the color channels of the image. "). 
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31. With respect to claim 12, Meier further discloses "setting a light source in an object space 
in which the three-dimensional object is provided {3 rd paragraph of section 3.2: 'The reference 
picture used for color information is typically a smooth-shaded rendered image of the surface 
with appropriate color attributes and lighting. "; the algorithm in Figure 2 shows the step of 
"create reference pictures using geometry, surface attributes, and lighting"; Figure 3 shows 
shading the geometry to create a color reference image); wherein the arranging each of the 
plurality of brush images includes determining the arrangement angle of each of the plurality of 
brush images by synthesizing a view direction with the normal line to the surface of the three- 
dimensional object" (5 th paragraph of section 3.2: "This surface normal shader projects the 3d 
surface normals into two dimensions along the view vector or another specified vector. "; 3 rd 
paragraph of section 3.3: "For example, we may specify that brush rotations be determined by 
an orientation reference picture... "; 8 th paragraph of section 3.2: "To apply the attributes, the 
brush image is either used directly or cut from a sheet of texture. ..rotated to the orientation... "). 
Meier does not disclose the "specified vector" is a "light ray direction of the light source set." 

32. At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to use a light ray direction of the light source set as the specified vector in the method 
disclosed by Meier. The motivation for doing so would have been to avoid changing the 
orientation of the brush strokes in each frame of animation, giving the animated object a 
consistent look, as light sources typically do not change position between frames in contrast to 
view vectors. For example, Meier states this aesthetic preference in the second paragraph of 
section 5.2: . .we prefer to have brush strokes oriented with respect to the surface and not 
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change as the surface animates. " Therefore, it would have been obvious to further modify the 
combination of Meier and Arias to obtain the invention specified in claim 12. 

33. With regard to claim 13, Meier discloses "the generating at least one of retouched image 
of the three-dimensional image includes generating at least one of retouched image by selecting 
any one of brush image to be arranged according to a predetermined condition" as shown in 
claim 15. Meier does not disclose "changing the brush image." At the time of the invention, it 
would have been obvious to a person of ordinary skill in the art to change the brush image. The 
suggestion for doing so is given by Meier in the third paragraph of section 3.3: "Using 
randomness is important in achieving a hand-crafted look; therefore, we can randomly perturb 
the brush stroke attributes based on user-selected parameters." Thus, the motivation for doing so 
would have been to give a hand crafted look of a painter changing strokes. Therefore, it would 
have been obvious to further modify the combination of Arias with Meier to obtain the invention 
specified in claim 13. 

34. Claim 14 is met by the combination of Arias and Meier, wherein Meier discloses "the 
generating at least one of retouched image of the three-dimensional image includes generating at 
least one of retouched image by changing a size of each of the plurality of brush images to be 
arranged according to a predetermined condition" {6 th paragraph of section 3.2: "Finally, the 
brush size reference picture is a scalar image that encodes x and y scaling information. We 
linearly map the range of values in the image to the range of user-specified sizes so that the 
areas with small values are painted with the smallest brushes and the areas with high values are 
painted with the largest brushes. "). 
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35. Claim 15 is met by the combination of Arias and Meier, wherein Meier discloses "the 
generating at least one of retouched image of the three-dimensional image includes generating at 
least one of retouched image by selecting any one of brush image to be arranged according to a 
predetermined condition" (Figure 3 shows selecting one brush image; Figure 5; section 3.1: 
'We employ a simple method that starts with a parametric surface and a desired number of 
particles. "; 2 nd paragraph of section 3: "Each brush stroke renders one particle. "). 

36. Claim 16 is met by the combination of Arias and Meier, wherein Meier discloses "the 
arranging a plurality of brush images so as to superpose a part of the plurality of brush images on 
one another part of the plurality of brush images includes arranging the plurality of brush images 
so as to superpose a part of a predetermined number of brush images of the plurality of brush 
images on one another part of the plurality of brush images {Figure 8 and caption: "Compositing 
a haystack from several layers. Each layer of the haystack is shown by itself on the left while its 
contribution to the composited image is shown on the right. ") in a predetermined direction from 
a position at which any one brush image of the plurality of brush images when arranging the 
plurality of brush images" (3 rd paragraph of section 3.3: n For example, we may specify that 
brush rotations be determined by an orientation reference picture, but to eliminate the 
mechanical look of the brushes lining up perfectly, we specify that we are willing to have brush 
orientations fall within the range of -10 to +20 degrees from the orientation given in the 
reference picture. "). 

37. Claim 17 is met by the combination of Arias and Meier, wherein Meier discloses "the 
arranging a plurality of brush images so as to superpose a part of the plurality of brush images on 
one another part of the plurality of brush images includes arranging the plurality of brush images 



Application/Control Number: 1 0/66 1 ,645 Page 1 8 

Art Unit: 2628 

so as to superpose the part of the predetermined number of brush images of the plurality of brush 
images (Figure 8 and caption: "Compositing a haystack from several layers. Each layer of the 
haystack is shown by itself on the left while its contribution to the composited image is shown on 
the right. ") on one another part in the predetermined direction based on an arrangement angle of 
any one brush image of the plurality of brush images when arranging the plurality of brush 
images" (3 rd paragraph of section 3.3 (emphasis added): "For example, we may specify that 
brush rotations be determined by an orientation reference picture, but to eliminate the 
mechanical look of the brushes lining up perfectly, we specify that we are willing to have brush 
orientations fall within the range of - 10 to +20 degrees f rom the orientation given in the 
reference picture. "). 

38. Claim 18 is met by the combination of Arias and Meier, wherein Meier discloses "the 
generating at least one of retouched image of the three-dimensional image includes generating at 
least one of retouched image by shifting positions at which the plurality of brush images are 
arranged as time passes" (7 th paragraph of section 3.2: "Brush stroke position comes from the 
particle 's position in screen space. Position may be modified by a function such as moving it in 
the direction of a velocity vector or adding noise. "; Figure 7 shows the shifting of a plurality of 
brush images in a beach ball animation). 

39. Claim 19 is met by the combination of Arias and Meier, wherein Meier discloses "the 
generating at least one of retouched image of the three-dimensional image includes generating at 
least one of retouched image by shifting arrangement angles of the plurality of brush images as 
time passes" (3 rd paragraph of section 3.3 (emphasis added): "To maintain coherence, a seed is 
stored with each particle so that the same random perturbations will be used for a particular 
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particle throughout an animation ... For example, we may specify that brush rotations be 
determined by an orientation reference picture, but to eliminate the mechanical look of the 
brushes lining up perfectly, we specify that we are willing to have brush orientations fall within 
the range of -10 to +20 degrees from the orientation given in the reference picture. "). 

40. Claims 5 and 6 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent No. 5,966,134 to Arias in view of Barbra J, Meier, "Painterly Rendering for 
Animation," Aug. 4, 1996, SIGGRAPH '96 Conference Proceedings, p. 477-484 (herein 
referred to as "Meier") in view of Linda G. Shapiro and George C. Stockman, "Computer 
Vision," Jan. 23, 2001, p. 279-283 (herein referred to as "Shapiro et al"). 

41. With regard to claim 5, Meier discloses "the arranging a plurality of brush images so as 
to superpose a part of the plurality of brush images on one another part of the plurality of brush 
images includes arranging the plurality of brush images at positions within the rendering region 
on the basis of the shadow information calculated" {Figure 8 shows arranging brush images 
according to shadow and highlight regions). Meier discloses in the caption of Figure 8: "We 
used image processing techniques on the color reference picture to isolate the shadow and 
highlight areas to be painted separately." Meier does not expressly disclose specifics of the 
image processing techniques referenced, in particular that the "positions in which the brush 
images are placed satisfy a predetermined brightness condition." 

42. With regard to claim 6, Meier discloses "the arranging a plurality of brush images so as 
to superpose a part of the plurality of brush images on one another part of the plurality of brush 
images includes generating a first retouched image by arranging the plurality of brush images at 
positions are determined by image properties and generating a second retouched image by 
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arranging the plurality of brush images at positions determined by reference image properties the 
rendering region on the basis of the shadow information (Figure 8 shows a first, second, third 
and fourth retouched images, as well as arranging brush images according to shadow and 
highlight regions). Meier discloses in the caption of Figure 8: "We used image processing 
techniques on the color reference picture to isolate the shadow and highlight areas to be painted 
separately." As shown in the previous paragraph, Meier does not expressly disclose specifics of 
the image processing techniques, in particular that the "positions in which the brush images are 
placed satisfy a predetermined brightness condition." 

43. However, Shapiro et al discloses an image processing technique on a color image to 
isolate the shadow and highlighted areas based on "a predetermined brightness condition" 
(section 10. L 1, p. 281: (( In image analysis, the vectors represent pixels or sometimes small 
neighborhoods around pixels. The components of these vectors can include: 1. intensity values, 
2. RGB values and color properties derived from them... Algorithm 10.1 on page 282; Figure 
10 A shows the results of K-means clustering). 

44. At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to use the K-means clustering algorithm to identify image regions based on a 
"predetermined brightness conditions" of the reference image, as taught by Shapiro et al, in the 
system disclosed by Meier. The motivation for doing so would have been to isolate shadow 
areas in the reference images in order to arrange the brush images for artistic effects (shown in 
Figure 8.) The suggestion for doing so is given by Meier in the caption of Figure 8: "We used 
image processing techniques on the color reference picture to isolate the shadow and highlight 
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areas to be painted separately." Therefore, it would have been obvious to combine Meier with 
Shapiro to obtain the invention specified in claims 5 and 6. 

Conclusion 

45. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. U.S. Patent No. 5,592,597 to Kiss discloses rendering images using brush primitives. 
U.S. Patent No. 6,268,865 discloses simulating painting three-dimensional images. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jason M. Repko whose telephone number is 571-272-8624. The 
examiner can normally be reached on Monday through Friday 8:30 am -5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ulka Chauhan can be reached on 571-272-7782. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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